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: IDENTIFIERS 

ABSTRACT ' 

To create not -a text-bound but a reader-based 
procedure tor identifying global coherence within a discourse, five 
-major writing tasks of 13 college students, enrolled in a basic skills 
composition course were evaluated by three readers — doctoral students 
and faculty members in English and Reading Education. After choosing 
the five most and the five least coherent papers, the readers " , 
summarized the main' ideas of these texts and identified the- 
statements contributing to and detracting from their main ideas. 
Analysis of the readers' findings revealed no significant differences 
between highly coherent and highly incoherent papers in the 
percentage of statements contributing to global meaning. It did show, 
however," that the globally incoherent texts had a higher percentage 
of local incoherent statements and more frequently required readers 
to generate major inferences from these statements. . Results indicated^ 
little reader agreement either on which propositions in the moire 
incoherent papers, were significant or irrelevant, or on the global 
meanings of any pape*s> coherent or not. The findings Suggest that 
more coherent texts supply readers with a greater number of multiplo 
cues for the building of meaning macrostructures and thus require - ' 
fewer processing resources on the part of the reader. Because reading 
is tT transactive process, however, the existence of multiple signs 
does not guarantee a shared understanding of even the. most coherent 
texts. (MM) • 
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Introduction ~ 



TEXT COHERENCE AS AN lf IN-HEADV^JBEN0^PON ^ 



Both theoretically and- pedagogical ly, the importance Of global coherence 
for the successful reprehension and production of text has been much dis- 
cussed within the ^reading and writing literature* If discourse 4e to be 
effective, it must be organized around a semantic 'core 1 , topic, or thepae. 
Theoretically, Halliday and Hasan (1980) have called coherence the enabling- 
function since it allows one to organize the meanings being constructed. Beau- 

grande (1980) has proposed that performance in text processing defends on the 

J " : •■ ' - . • 

extent of organization which the language user can impose on the .data being formu- 

lated during the. reading or writing act. Perhaps more c-han any other individ- 

ual, van Dijk (1980) has demonstrated the critical role which global coherence 

• < * 

serves in the generation of meaning. For van Dijk, global coherence is repre- 
sented ±n a text Y s macrostructure, that higher-level semantic framework which 
organizes the 1 local* micro structure of the text. Finally, from a pedagogical 
perspective, such instructional strategies as structured overviews, semantic 

mapping, and webbing techniques demonstrate the Influence which £he construct 

* * * • »■ • 

of global coherence has had on the educational community. ^ 

\ A fundamental question* arises^, however; in regard to the very nature of ' 

global coherence itself; that beihg, exactly vSszt. Aakes a coherent text co- 

herept? Or r operationally 'stated, how <;an the global coherence of a text be 

identified? According to >*an Dijk (1980), .the global coherence of any text 

can* be objectively determined through the application oi^our macro- operators 

Paper presented at the Thirty-fourth Afeual Convention, of the Conference on College 
Composition and Communication, Detroit* March 1983. 



which reduce, organize, and summarize the local data ot the discourse. Stein* 
(1978), Kintsch (1977> ayd Rumelhart (1975) have proposed that the macro- ^ 

structure of a narrative can be Ascertained through the identification 6f its * 

— S" * r 
key story .grammar elements. They argue that all stories, if they are to be 

coherent, must concaia these key components. 

i . » . • - 

The limitation of text analytic techniques of these types are their formalis 
tic, logical, and text-based natures. Coh&reqce is perceived as an objective 
attribute of the discourse itself and is delineated through the use of text- 
based procedure^. Violated is the notion of text and Its coherence as a trans- 
actional .process and ignored is the critical variable in the comprehending act, 
i.e. the reader. Coherence is not, this paper argues, indigenous to the text 
itself. It is not a text-bound at triitite .residing within the confines of the 
discourse, but rather an "in-head" phenom^on created through a transaction 
between the reader and the cues signed by jtije writer through. the text. 

Given thi* limitation of ourrent text-based techniques' for analyzing co- 
herence, there is a need for a procedure which takes its cue from the reader. 
Global coherence and its attributes as defined by the reader constitutes fne 

• • 

data to be presented within this stud?. 

Data Collection and Analysis 

A jtwo-step, reader-based procedure was used to identify coherent and in- 

• i 
coherent texts and to examine" their key internal diffetertces. Figure 1 con- 
tains the directions which refers followed when analyzing the texts. Texts 
were produced by thirteen students enrolled in a university basic skills 
composition course. The most and least -coherent texts were identified from 
five major writing tasks which the students had experienced durffeg the course 
of the semester. Texts were read and ranked In .terms of their global coherence , 

by three readers. Readers were doctoral students/and faculty members in 

' 1 - • i ■ 
English and Reading Education. \ 
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S tep Ont : Tenet vary In the degree co which chey cohere around an Implicit 
or explicit central point or idea, V** in chair conceptual unity. 
* Read the following sat }£ texts aad rank order them from one co 

thirteen in :erae of chair global coherence, i.e. chair general 
or overall coherence. On che coherence continuum, one should be 
J t che aoec coherent and thirteen che ieaet* ^ m 

Seep Two>: , (frart A) * 

"ID- 1 . » * 

Read che text thro ugh and than generic* • ehraaV co four sentence 
summary which you feel capturee the implicit or explicit central 
point or idea the text intended to convey. 

♦ (Parte B and C) > * 

Keeping the auaaairy which you generated for each text in Bind, 
re-read each c*xt end complete the following direc clone, 

V* - * 

1. JJeins; (he blue^aarkar . highlight tnoee porclone of' che cent 

which ware major and direct contrlBotora co your suaaary , 

2. Using che vallow aarfcer . highlight chose portions of the text 
which did not^ contribute* to your, summer* becauae: 

a) theae portlona ware irrelevant touhe chruat of the text. 



i 



b) 



c) 



meaning breaks down for you aa .e^ reader. I.e. chare, ware 
gape requiring che tasking of major inferencae in order 
co eacabliah meaning and maintain * coherence , or 

. 1 1 



t be eetebliahed . 

After identifying each of theae portlona, plea*; indicate vourl 
reasons for '^itVtt^nn ig ^ P" e Y*M ^ m iWWBglaM Uccar' 
at the end of each portion , Tou any or say not- Una portlona 
of the text which are incoherent with your summary- 

All portlona of the text left unmarked should be meaningful and 
relate directly or indirectly to your summer*/ but not be ma tor 
concrlbutore . 



' Figdre 1. A ^reader-based system for text analysis. 



After the global coherence ranking was completed, an average rank across 
readers -was generated for each text. Baaed on these means* the five most and 
the five least. coherent texts were identified. At the ends of the continuum, 
there was vide agreement among readers as to which texts were high and low In 
coherence* / 

^ The second step in the analysis procedure involved identifying those 
within-lext factors affecting a reader f s ability to generate global coherence 

'when processing text, using the five high and five low in coherence papers pre- 



. . ■ ... V 

viouely 'identified. Each text was read by three readers and, analyzed in sev 
eral ways. # t 

First, readers were* asked to read^ach text and to generate a three to 

^ . . . 

four sentence summary which captured the implicit or explicit central prfint / fw 

: * . 4* 

which they felt die authbr intended, to convey. After generating their summajfie*, 
readers highlighted in blue marker those portions in each text whfich were major 
and direct contributors to th^ir summaries. An yellow marker, readers were 
asked to highlight portions which were incoherent with their summaries because ; 
they were 1) irrelevant to the thrust of the text, 2) Required the making of 
a major inference so that meaning and coherence could be maintained, or 3) were 
found to be meaningless. All segments not highlighted were meaningful and re- 
lated to the summaries, but were not major contributors* 

, Following tho generation of the summaries and the markings of the texts, all 
texts and summaries were propositionalized using procedures developed^ry Turner 
*gd Greene (1977). The propositions from tftie texts and summaries wettr used to 
generate hypotheses concerning four aspects of coherence: 1) propositions cop- ■ 
tributlng to coherence, 2) propositions contributing to incoherence, 3) the 
.kinds of propositions contributing to text incoherence, and 4) the effect which 
coHerent a*d incoherent texts had on the readers 1 ability to generate shared 
meanings in their sunAries . ""j « 

Results: Wi thin-text Factors Affecting Coherence 
Propositions Contributing to Coherence 

In order to measure the propositions contributing to textlcoherence in • 

' ; * ^ - 1* 

the two text types, the number of propositions underlying portions nsfrked in 
blue were identified for each text. The mean number of proposition* high- 
lighted by the three readers for all texts both high and low in coherence was 
then determined, a percentage generated, and the variance in mean percentages 



between the two groups calculated. ~~ - 1 
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Figure 2. Summary of the factors contributing to coherent and 1 
incoherent texts. ' — 

Figure -2 represents the results of this measurement, as well- as others with- 
in this study. As, indicated in the first row,'"Heah Percentage of Contributing 
Propositions", there was no sinif leant difference, as measured by a pooled c 
test at the £< .01 level, j^he overall percentage of propositions which readers 
had identified as contributing to their summaries, texts high in coherence' *<jh- . 
tained significantly ho mori such propositions than those low in coherence. As 
an isolated factor, percentage of contributing propositions was not a dis- 
t ingui4hiiig characteristic between texts high «and-low in* global coherence. Both 



• ■ o 

types of texts appear to contain salient propositions upon which readers are 

•'. * ^ 

able to Build macros>ructures. * * 

* ' * ■ t i« ^ 

Also Identified were those particular propositions which Vere highlighted 

as contributing to thejftr summaries by* all three teadex^u This was enalyzed in^ 

* 4 ■/ • . 1 

order to ascertain whether or not coherent- ^texts result in a convergence among 
readers as to which meanings are the' most important to the overall thrust^of the 
discourse. The analysis found, as indicated in row two of Pigufe 2, that "the 
percentage of shared propositions did vary significantly between those two text 
type* (t-3.70, jj^.OI). From the total of 315 propositions found in the five 



highly coherent texts* 7X were identified by all three "readers as contributing 
to* their summaries. For texts low in coherence, the mat£h ahong propositions 



was 3X, based on a combined total of, 301 propositions. Texts high in coherence, 
therefore, resulted in readers more often agreeing on which propositions were 
the most salient in terms of 'contributing Co their macros true tures. ^ 

As Interesting as the fact, is t^at ^coherent texts allowed for more agree- 
ment among readers as to which segments of textN^e of prime, r importance, is 

«• 

the fact' that so little agreement actually existed among either text type. For 
the most part, readers took radically different perspectives toward any given 
text, demonstrating t^ie transactionar?hature of the reading pi*>cess. • , 

Pr opositions Contributing to Incoherence s • . ^x^t . _ 

: — — v y jj- 3 1 

The second aspect of cohednce for which Iqfeotheses were generated con- 
cerned jrhose propositions which readers saw as contributing to t^xt incoherence. 



The percentage of local propositions highlighted in yellow by th> readers be- 
cause they were- found tq be incoherent was calculated and measured in the same 

■ ■ • • v* x 

mann er as was the percentage for propositions found to be aa fe co ntributors to 

reader macros tructures. As row thxbp in Figure 2 illustrates, there was a 



-significant difference in the mean percentage of propositions f otihd to be in- 
coherent in high' coherence tracts and those .texts low in coherence (t-4.02, 



£^.01). On the average, only of the local propositions in .highly co- 
herent texts were incoherent with the macrostructures generated by the readers. 
In contrast » 17% of all lodal propositions in texts low in coherence were found 

to be incoherent with the mac r ©propositions of the readers. . 

* 

Therefore » one withJLn-text factor contributing to global coherence is a 
higher occurrence -of ^locajl propositions which readers find incoherent with c {, 
their macropropositions. This incoherence would ..indicate that these local 
propositions could not be as easily utilized during text processing and macro- 
structure generating. It also means that there exists * smaller propprtion of 
propositions in these texts which support the building of macrostructures. 
While the mean numbe^of propositions contributing to the macrostructures re- 
raained constant across text typqs, there appears to be much less data in $he t . 
incoherent texts offering conceptual support to, these propositions and their 
resulting macrostructures. 

Though there existed a higher percentage of propositions fdund to be in- r - 
coherent in texts low in global coherence* which propositions were fftgh- 
lighted as such varied across readers. As indicated in row four/of Figure 2, 
there was virtually no agreement on which propositions were incoherent. In 



fact, readers can more easily agree on' those "propositions contributing to 
their macrostructures than they can on those which they find c^'**/ incoherent. , 
At this point in the analysis, several hypotheses can be mada*aoncerniag I \ 
those Within-t^jt factors affecting text coherence. First, 'all texts', whetbei 
.high or low in coherence, contained equal proportions of propositions which 
readers can utilize as semantic cues for ponsttucting macrostructures. Writers 
were aither al4e to supply readers with signs, as expressed in propositions, 
contributing to the generation of macrostructures, pi readers "we** able to im- 
vposci such/sigris on the text. " What does appear to distinguish coherent texts 
frdra those which readers find to be incoherent is the lack of conceptual 



suppbrt for main and direct contributing pjoposif ions •yitbia incoherent textk. 
More coherent texts offer a greater variety and Selection of propositions 



•from which readers tan construct a coherent whole. 

y ' . ■/.■■ \ 

Secondly, the high degree of incoherent propositions found within less v 

coherent texts may require a higher degree of reader inferencing during dispour^e 
processing, than ^^ld be necessary in more coherent texts. This inferencing 
would demand a higher degree gi resources from the system and focus tjtje reader's 
attention on extensive cognitive searches for the location and retrieval oif 
data upon wh^ch such inferences could be made. In a .sense, these, heavy in- 
ferencing demands begin to turn the reader into the Writer bf the text. While 
there is probably a delicate and fine balance between thoste cognitive £j/ntri- 
but ions made by readers and those made by writers, incoherent texts appear > to 

* . ____ •..*.. \ • 

violate this balance."- In .texts of this type, readers may be required to gett- 
er a^e more meanings lacking textual support than th$y feel comfortable doing. - : 

' Thirdly, this high degree of inferencing necessary in incoherent texts 
might also result in^more/Qntative text worlds. Sinc£ the writers of inco- 

v ' '*".** . " "si./- 

he rent texts-had supplied the readers with fewer text cues for building these 

* tj 

worlds, readers must supply more of this information from their backgrounds. 
Given this heavy reliance on prior knowledge which processing these texts 
entails', the lack of propositional support for the construction of macropropo- 
sitlons, and the skeletal nature* of the macrostructures which result, readers' 
may Feel less sure of their text worlds. Therefore, tentativeness and process- 

ing demands, rather than inability to gain meaning and generate macrostructures,' 

•• • . ■ . • ■ , j •• •' . : 

may.be the determining factors as tp whether readers perceive a text aa co- 

/ ' ■ * . " . . 

herent or not . * . 9 

Finally, texts high in coherence allow readers to more of ten agree on 

* * • • •'■*■..'•" 
which meanings are the most Important and salient to the overall structure of 

the text. These texts 1 appear to supply readers with multiple cues allowing for 



this nwcuai aigreferaent* Agreement was not found* hqv/ever, on which propb- 
git Ions readers perceived to be incoherent* It appears that incoherent propo- 
sitlons are. not classified as such based splely on attributes within the text* 
. but al^p on the knowledge which the reader brings to the page*. In any par- • 
* ticular text,, different readers perceived different p^jpions as being Incoherent 
and^vajried In, their ability or willingness to utilize certain propositions 
in constructing their global configurations of meaning as they processed . text. 

Kinds of Propositions Contributing to Incoherence ^ 

The third. aspect oP^alj^rence which was examined in the study addressed* it-* 
self to the exact nature 1 of propositions which were* found by readers to be 
incoherent in the two text ty^es. When readers highlighted in yellow those por- 
tions of text vfjich were incoherent A/ith their macrostructures, they Indicated 

^^^^ * • 
\>ne of three relfsons for each* marking. The reasons for the markings were 

tabulated* means generated across the threfe readers for each set of five texts, 
and pooled t tests calculated. Figure 3 contains the results; of thespr analyses. 
As indicated in the figure there was no significant difference between the mean 



percentage of propositions, found to be irrelevant in either of the two text types. 
Each type contained almost the exact same percentage of irrelevant propositions. 
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Fifture 3 » • Th*ytuk^^ to .tut incoherence M 



A significant difference was found, however, in the percentage of propo- 
sitions requiring major inferences (t»3.90, £^*01). Texts low in coherence 
contained more than three times (7% vs. 2%) as many propositions requiring such 
inferenclng in order that meanings could be maintained than did texts high in 
coherence. 

Finally, texts low in coherence contained a significantly larger percentage 
of propositions for which readers could generate jio meaning whatsoever (t*3.8, 
£^.01). On the average, bX of all propositions within texts low in coherence 
were fo'ind to meaningless by readers as compared with only .003 in highly 
coherent texts. 

The high degree of non-meaning bearing propositions in low coherent texts, 
combined with the larger number. of propositions requiring the making of major 
inferences, adds further support to the hypothesis that aacrostructure ten- 
tatlveness is a major characteristic of incoherent texts. On an average, 13X 
of all propositions foutyi within these texts did not affc^^readers direct cues , 
for the construction of meaning. Readers were either required to add substantial 
amounts of Information from their backgrounds to these propositions or simply 
had to resign themselves, to the fact that no meaning could be constructed- Though 
readers are still capable of generating macrostructures from these texts, the? 
may feel less comfortable with them, realizing the high percentage of propo- 
sitions in the text not supporting, their summaries. < 

Once £«flritn> however, it should be noted that there was almost no reader con- 
sensus as to exactly wh^ch propositions wiere irrelevant, which required the 
making of major inferences, or which were meaningless. Different readers formed 
different transactions with different texts and the meanirigfulnes of any inJi- 

: ' J *~ 

vidual propositions became" dependent on the meaning yhich the reader could gen- 
erate from the supporting text and .-his or her background knowledge. 

Even more interesting were those propositions which were disputed among 



11. ^ 

readefe. Disputed propositions rfre those un#s of .meaning^ which one reader had 
highlighted as being major and direct co*wlbutors to his/ Sir he* macros true ture 
and another had marked ^s iji&ohere^C When analysis of the- texts was' first 
initiated , the researcher had nor rmtl^ipated the occurrence of audh conflicts. 
"However, as aaalysi% of the data proceeded* such conflicts became ree.UAy 
apparent and were subsequently included in the evaluation of the texts* * 

As indicated in the last row of Figure 2, the mean percentage .of disputed 
propositions was significantly greater for texts low i^ coherence at the £ ^£.01 
level (t-3.70). On an average, 7% of all propositions within low coherence^ 

texts were disputed by readers. This is, in contra i to a mean of IX for high 

• • • 

coherence texts. * # ' 

Given the greater occurrence of disputes within incoherent texts, it may be 
the case that for these texts*, reader ability and/or willingness -to make major 
, inferences plays a role of greater imj rtance than it does for more coherent 
texts. Particular readers may^ lack the background necessary to create meaning 
for certain portions of text and the writer may not Supply enough textual cues 
to support such generation of meaning. Other readers may have the required 

background, but not feel comfortable using the inferred information to support 

• • • 

their macros true turen. Finally, there may exist readers who have both the back- 
ground upon which the Inferences can be based and who also feel comfortable using 
these meauings upon which to generate their macrootructures. 

. . . / • f . 

Results* Coherences Macrostructurest and Shared Meaning 

*. * *- « 

The final aspect o£ coherence analyzed within this study concerned th* 

relationship* between text coherence and ita influence on the conatructfion of ? 

. shared meanings among reafllqre* n \ • \'*tTVj 

^ / v 

— * degree to which tenders shared meanings in their* macro* true cures' 

quired a multi-step procedure. ^ Pits t, propositions containing the same or 

slKflar maaalngs *r*re identified across the three susiwariea for each of the ten 



texts. Because the number of propositions varied across summaries, a staple 
percentage' of sh^red^propositions could not then be, calculated. Instead, a 
percentage was generated for ,each of the three sjwmaries per text. The per- 
centage was based on the number of propositions within a summary«vhich were 
semantically similar with prepositions found within the other two summaries. 

The percentages of all three texts were, then combined and a "mean percentage 

( 

generated, * 

Finally, the iive mean percentages across each set of text types, coherent 
and incoherent* --ere averaged into a grand mean. The two grand means were. used 
for calculating the dif f erencc-8 in shared meanings between texts high and low in 
coherence, using a pooled t test-* As Figure 4 'illustrates , there was not a sig- 
nificant difference in shared meanings between texts high and low in coherence * 
at £ <£.-0l (t-1.68). Thirty-seven percent of all mac^oproposicions generated frc*- 
cohercn*t texts were shared among; readers and 2bX of all propositions generated- 
from incoherent texts. In fact* for' nontext, coherent or "incoherent, did 
readers agree on >he ; global meanings any more than f^fty-one percent of the 
ti«e. Readers were simply not ablejto agree upon. what the global meanings of 
any text 'were to any grea^extent, each reader understanding the . text differently/ 
Therefore, at the^ macro level, coherent texts >id not allow readers to converge' 
in their shared understandings of text, hased on a statistical analysis, any 
«ore than did texts\bich were less coherent. 
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This findidfc was not a predicted 'one, given tVrs^act that readers were ' # 

more lively to utilize the same propositions for the conduction of macro- 

structures on Coherent texts (7%) than on incoherent texts (32). While this 

difference was statistically significant, it appears not to be semantically 

significant in tferms of allowing readers to generate more semantically similar e 

macrtf&ttuctures for coherent texts. Simply using the sane propositions for' 

the building of macroproposi$ions does not guarantee' that their^ synthesis 

will result in similar meanings. Other propositions exist in the text which in- 

» • 
directly support the evolving macros true cure. Given the existence of these 

propositions, as well as variation in reader background, shared meanings only 

exist to a limited extent, regardless of the coherence of the text. 

• ■ * 

Summary and Conclusions 
-In summary, what makes a text? coherent is probably based on an optimal 
ratio between those cues supplied by the writer andr"£ho«"^raerate^by this — 
reader when processing the text. As reader background Varies, so too will the 
degree to* which the reader finds particular portions of a text coherent. As 
the cues laid out in the" text by the writer vary, so too will coherence of 
the text for the reader. The data in this study suggests' that coherent texts 
supply readers with multiple cues for the building of macrostruetures and 
result in configurations of meaning which are leas tentative, thus requiring 
fewer processing resources on the' part of the- reader. The existence of these* 
multiple signs in coherent texts, however, do not result -in a shared under- 
standing of text. Reading, by its very nature, is a transactive process in 



which meanings are generated as well as maintained and writers cannot neces- 
sarily assume titat their readers will understand their texts as intended jutft 



because they are coherent*. 

- • - : 
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